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Abstract 

Pairs {A, B) of mutually annihilating operators AB = BA = 
on a finite dimensional vector space over an algebraically closed field 
were classified by Gelfand and Ponomarev [Russian Math. Surveys 
23 (f968) f-58] by method of linear relations. The classification of 
{A, B) over any field was derived by Nazarova, Roiter, Sergeichuk, 
and Bondarenko [J. Soviet Math. 3 (1975) 636-654] from the classifi- 
cation of finitely generated modules over a dyad of two local Dedekind 
rings. We give canonical matrices of {A, B) over any field in an explicit 
form and our proof is constructive: the matrices of {A, B) are sequen- 
tially reduced to their canonical form by similarity transformations 
{A,B) ^ {S-^AS, S-^BS). 

AMS classification: 15A21. 
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1 Introduction 



We consider the problem of classifying pairs of mutually annihilating opera- 
tors 

A,B:V ^V, AB = BA=0 

on a finite dimensional vector space V. 
The pairs {A, B) were classified 

• in ^ over an algebraically closed field by method of linear relations, 
and 

• in fl6[ [12] over any field F as modules over ¥[x, y]/ (xy); 

these results are surveyed in Remark [H 

Our classification of [A, B) over any field is constructive: we give an 
algorithm for reducing its matrices to canonical form by similarity transfor- 
mations 

{A, B) ^ S-'^{A, B)S := {S-^AS, S-^BS), S is nonsingular. (1) 

Our paper was inspired by Oblak's article [T7j, in which she character- 
izes all possible pairs of Jordan canonical forms ( J^, Jb) for pairs {A, B) of 
mutually annihilating matrices AB = BA = over an algebraically closed 
field. For this purpose, she puts one matrix in Jordan form, then she uses 
only those similarity transformations that preserve it and reduces the second 
matrix to a simple form. We continue to reduce the second matrix until 
obtain a canonical form of {A, B). 

In Section [2] we formulate the only theorem of this paper: we classify 
pairs {A, B) of mutually annihilating operators and give a canonical form of 
their matrix pairs {A, B). In Sections [3H5] we prove this theorem and reduce 
[A, B) to its canonical form (see the end of Section [2]). 

Remark 1. Pairs {A, B) of mutually annihilating operators were classified by 
different methods: 

(i) Gelfand and Ponomarev [H| Chapter 2] classified the pairs {A, B) over 
an algebraically closed field by using the apparatus of MacLane's theory 
of linear relations. They arrived to this problem studding indecomposable 
representations of SL(2,C). Using their classification of {A,B), Schroer [T9] 
classified the irreducible components of the varieties V{n, a, h) of pairs (A, B) 
of n X n matrices satisfying AB = BA = A"^ = B^ = 0. 
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(ii) Nazarova and Roiter [TB] classified finitely generated modules over 
a dyad D of two local Dedekind rings. In the subsequent paper [TB], Bon- 
darenko, Nazarova, Roiter, and Sergeichuk corrected two inaccuracies in [15] 
and derived classifications 

• of finite p-groups possessing an abelian subgroup of index p, by taking 
D = Zp[x]/(x^) where Zp is the ring of p-adic numbers, and 

• of pairs {A, B) of mutually annihilating operators over any field F by 
taking D = ¥[x, y]/ (xy). 

It is a very curious circumstance that two classification problems, so unlike at 
first glance, admit of a like solution. Levy [131 HI] extended the classification 
of modules over D to modules over Dedekind-like rings. 

(iii) Laubenbacher and Sturmfels [12] also derived a classification of {A, B) 
from a classification of finitely generated modules over D = ¥[x,y]/{xy). 
They used the presentation of each finitely generated module M over D = 
¥[x,y]/{xy) as a quotient of a free module 

Jjn ^j^m ^ ^ ^ 

where / corresponds to a matrix A{x, y) with entries in D. This presentation 
is nonunique: / can be multiplied on the left by an automorphism of D"^ and 
on the right by an automorphism of D". Each automorphism of D"^ is given 
by a nonsingular matrix over D; thus, a polynomial matrix A{x, y) can be 
reduced by elementary transformations over D. (By an analogous method, 
the problem of classifying finitely generated modules over any finite dimen- 
sional algebra can be reduced to a matrix problem, see [5] and [2T1 Section 
2.5].) Laubenbacher and Sturmfels [L2l developed an algorithm that trans- 
forms A{x, y) to a normal form, which is analogous to the Smith normal form 
for a matrix over a polynomial ring in one variable. Their algorithm partially 
uses the matrix reduction carried out in [16]. The ring D = ¥[x,y]/ {xy) also 
appears in a variety of other contexts, such as i^'-theory [H |T0] and algebraic 
geometry [TTl Lemma 4.5]. 

Remark 2. The classification of pairs of mutually annihilating operators is a 
bit surprise because 

• the problem of classifying arbitrary pairs of operators {A, B) is consid- 
ered as hopeless since it contains the problem of classifying any system 
of linear operators (i.e., representations of an arbitrary quiver); see, for 
example, [21 E], and 
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• the commutativity condition AB = BA does not simplify the problem 
of classifying {A, B) since by [9] the classification of pairs of commut- 
ing operators implies the classification of pairs of arbitrary operators. 
Indeed, two pairs {A, B) and (C, D) oinxn matrices are similar if and 
only if two pairs of commuting and nilpotent matrices 
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are similar (all blocks are n x n). 

Nevertheless, Belitskii's algorithm [21 [21] converts an arbitrary pair {A, B) of 
n X n matrices to some pair {Acan, -Bean) by similarity transformations such 
that two pairs {A, B) and {A', B') are similar if and only if 

(^can; -Bean) = (^ean) -^ean) • 

Thus, the pair (Aean, -Bean) can be considered as a canonical form of {A, B) 
for similarity, but there is no satisfactory description of the set of matrix 
pairs (Aean, -Bean)- The algorithm presented in Sections [3H5] is a special case 
of Belitskii's algorithm. 



2 Canonical form of matrices of a pair of mu- 
tually annihilating operators 

All vector spaces and matrices that we consider are over an arbitrary field F. 
Let us define two types of pairs of mutually annihilating operators 

A:V -^V, B:V ^V, AB = BA = 0, 

on a vector space V (to distinguish the operators, we use a double arrow =^ 
for B). 

Definition 3. A pair of mutually annihilating operators A : V ^ V and 
B : V ^ V is of path type if it is defined as follows. Let 

1 — 2 — 3 — •■■ — (t-1) — t (t ^ 1) (2) 
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be any path graph in which every edge is an ordinary arrow 
arrow (with this orientation). Take 



or a double 



V := Fei ©Fea 



and define the action of A and B on the basis vectors ei, . . . , et by (Ej), in 
which every vertex i is replaced by Cj and the unspecified action is zero. The 
matrix pair 

(A, B) (3) 
that gives A and B in the basis ei, . . . , is called a matrix pair of path type. 

Clearly the pair ([3]) is formed by mutually annihilating t x t matrices 
A = [ttij] and B = [bij], in which 



0-1+1,1 



1 ifi 
1 ifi 



(^ + 1) 
(^ + 1) 



in m 



.t-l. 



and the other entries are zero. Note that 



A + B' 



1 



Example 4. The path graph 

1 — >2 — ^3^4 
defines the following action of A and B on the basis vectors: 

A A B 

ei > 62 > 63 <^ 64 

and the pair {A, B) is given by the matrix pair 

(A 5) 
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Recall that every square matrix A is similar to a direct sum of Frobenius 
blocks 

'0 -Cn 







-C2 

1 -Cl 



(4) 



in which p(a;)' = x"' + Cix"~^ + ■ ■ ■ + c„ is an integer power of a polynomial 
p{x) that is irreducible over F (note that is the minimal polynomial 

of (jl])). This direct sum is uniquely determined by A, up to permutation of 
summands; see [HI Section 14]. If F is algebraically closed thenp(x) = x — X 
and the reader may use the n-hj-n Jordan block 



A 

1 A 







1 A 



instead of (jl]) in all the statements of this paper. 

Definition 5. A pair of mutually annihilating operators A : V 
B : V ^ V is of cycle type if it is defined as follows. 



(i) Let 



1 — 2 1 



V and 



(5) 



be a cycle graph in which every straight edge is — > or •^== and the 
arcuated edge is < — or =^ (with this orientation). 

(ii) Let this graph be aperiodic, this means that the cyclic renumbering of 
its vertices 

1 — 2 — t i — (i + l) — •■■ — (i-l) (6) 



is not an isomorphism for each i = 2, . . . , t. In other words, for each 
nontrivial rotation of this cyclic graph there is an ordinary or double 
arrow that is mapped to a double or, respectively, ordinary arrow. 
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(iii) By (ii), if has no double arrow, then it is the loop C; we associate 
with its arrow a nonsingular Frobenius block $ (or a nonsingular Jordan 
block if F is algebraically closed). If the graph has a double arrow, then 
we choose any double arrow and associate $ with it. 

Let kxkhe the size of $. Define the action of A and B on the fct-dimensional 
vector space 

V ■.= Vi®---®Vt, := Fea © ■ ■ ■ © Fe.fc, 

by ([5]), in which each vertex i is replaced by Vi and each arrow represents 
the linear mapping of the corresponding vector spaces. This linear mapping 
is given by $ if the arrow has been associated with $; otherwise, it is given 
by the identity matrix J^. 

The matrix pair [A, B) that gives A and B in the basis 

Cii, . . . , eik', . . . ; Cti, . . . , Ctk 
is called a matrix pair of cycle type. Thus, 

• if t = 1 and the loop 1 — 1 is an ordinary arrow (which is associated 
with $), then {A, B) = ($,0^); 

• if t = 1 and the loop 1 — 1 is a double arrow (which is associated with 

then (A 5) = (Ofc,$); 

• if t ^ 2, then A = [Aij] and B = [Bij] are block matrices (consisting of 
t"^ blocks and each block is of size x fc), in which for i = 1, . . . ,t: 



A 



iii 



(z + 1). 



B. 



iii 
iit 



+ 
U + 



(7) 



{ii i = t then alH + 1 in ([7]) are replaced by 1); the other blocks of A 
and B are zero. Note that 



A + B' 



'Ok 

* 



Ok 



0, 



Ok 



Ok 



Ok 



Ok 



(t^ blocks) 



in which Ok is the k x k zero matrix, one star is $ and the others are 
Ik. 
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(8) 



($ is 3-by-3) defines the following action of A and B on the basis en, ... , Cik 
of each space Vf. 



and the pair [A, B) is given by the matrix pair 
{A,B) 
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Let V := {A,B) and V := {A',B') be two pairs of linear operators on 
vector spaces V and V, respectively. Define their direct sum 

(A, B) © (^', B') := {A ®A:,B® B') on F © v. 

We say that V is isomorphic to V if there exists a linear bijection ip -.V 
transforming V to V'\ that is, 

i^A = A'<p, <pB = B'ip. 

Theorem 7. (a) Let A and B be two linear operators on a vector space over 
any field ¥, and let 

AB = BA = 0. (9) 

Then {A, B) is isomorphic to a direct sum of pairs of path and cycle types 
and this sum is uniquely determined by {A,B), up to 

(i) permutation of direct summands and 

(ii) replacing any summand given by a cycle graph ([5]) with the pair given 
by any cycle graph obtained from (jS]) 



by a cyclic renumbering of its vertices and/or 
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— if there are at least two double arrows then by transferring $ 
{associated with one double arrow) to another double arrow. 

(b) Each pair {A, B) of mutually annihilating matrices 

AB = BA = (10) 

is similar to a direct sum of matrix pairs of path and cycle types and this 
sum is uniquely determined by {A,B), up to transformations (i) and (ii). 

For example, the cycle graph ([8]) and the cycle graph 

4 4^ 1 ^ 2 — >3 



give isomorphic pairs of cyclic type. 

Remark 8. (a) The pair of path type given by ([2]) can be also given briefly 
by the sequence 

(ci, . . . , 

in which 

1 if the zth arrow is ordinary, 

fill 

2 if the ith arrow is double. 

(b) The pair of cycle type given by ([5]) can be also given, up to change of 
basis, by the system 

(ci,...,q;<I>) 

in which the sequence (ci, . . . , Cj) (defined by ( fTTl) ) is aperiodic and is 
determined up to cyclic permutation. 

In the remaining sections we construct an algorithm that converts a pair 
{A, B) of mutually annihilating matrices to its canonical form defined in 
Theorem [7|(b). 

• In Section [3] we reduce the general case to the case of nilpotent A, 
convert A to its Jordan canonical form, restrict ourselves to those sim- 
ilarity transformations that preserve A, and show that they induce on 
some submatrix D of B (containing all nonzero entries of B) a matrix 
problem solved in [151 [IS] . 
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• In Section m we apply the reduction described in [151 [TB] and transform 
D to a block form such that each horizontal or vertical strip contains 
at most one nonzero block, and this block is nonsingular. 

• In Section [5l extending the partition of D into blocks, we find a block 
form of A and B such that each horizontal or vertical strip contains at 
most one nonzero block, and this block is nonsingular. This implies the 
decomposition of the corresponding operator pair {A, B) into a direct 
sum of pairs of path and cycle types, which proves Theorem [71 

3 Reduction to a chessboard matrix problem 

Let us start to reduce a pair (A, B) of mutually annihilating matrices by 
similarity transformations ([T|) to its canonical form described in Theorem 

m- 

Lemma 9. (a) Each pair of mutually annihilating matrices {A, B) is similar 
to a direct sum 

{A', B') © ($1, 0„J © ■ • ■ © 0„J, (12) 

in which A' is nilpotent and each $j is an Ui x rij nonsingular Frobenius block. 

(b) This direct sum is uniquely determined by {A,B), up to permutation 
of summands and replacement of {A',B') by a similar pair {i.e., by a pair 
obtained by similarity transformations). 

Proof, (a) There is a nonsingular S such that 

S-\A,B)S = iA',B')®iA",B"), 

where A' is nilpotent and A" is nonsingular. By ffTOj) . B" = 0. Converting 
A" to its Frobenius canonical form $i © ■ ■ ■ © we obtain f|T2|) . 
(b) Let 

R-\{A', B') © (A", 0))i? = (C, D') © (C", 0) 
where C is nilpotent and C" is nonsingular. Then 

(A' © A")R = R{C' © C") 

imphes R = R' Q) R" , and so 

{A', B')R' = R'iC D'), A"R" = R"C". 

□ 
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Thus, we can suppose that A is nilpotent. Then is the only eigenvalue 
of A, and so we can reduce A to its Jordan canonical form J over any F. 
Combine all Jordan blocks of the same size into one block, and obtain 



J • J-mi (Or 



Jmt (Or 



in which 



Jrui (Or 







Ir. Or 



mi < 1712 < ■ ■ ■ < TTlt, (13) 



{m'^ blocks). (14) 



Making the same similarity transformations with B, we convert [A, B) to 
some pair (J^,C), which is similar to {A,B). By ffTOl) . 



j+c = cr 



0, 



hence, C has the form 



C 



'Cn 



C 



It 



Cti ■ ■ ■ Ctt 
(partitioned conformally to (1131) ) in which 

... 0" 



(15) 



(16) 



Cij 





D,, 



{miirtj blocks of size rj x r^); 



(17) 



in particular, Cu is partitioned conformally to flMj) . Combine all Dij into 
one matrix 

'Ai ... Du 

D-= (18) 

Ai ... Du_ 

We will reduce {J^,C) by those similarity transformations S^^{J^,C)S 
that preserve J^; that is. 



c^c' := s-^cs, s-^j+s = J 



(19) 



Since (J+,C) is similar to (J+,C"), implies J+C = C'J+ = 0. Hence 
the matrix C has the form defined in f|T6|) and f|T7|) with Cij and Dij replaced 
by Cl^ and D'^^. 
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Thus, transformations fll9l) preserve all (zero) blocks of C outside of D. 
In Lemma [TT] we show that transformations fll9p induce on D the following 
matrix problem (each matrix problem is given, by definition, by a set of 
matrices and a set of admissible transformations with these matrices; the 
question is to classify the equivalence classes of the set of matrices with 
respect to these admissible transformations; see O Section 1.4]). 

Definition 10. The chessboard matrix problem is given by 

(a) the set of all block matrices D = [Dij] , in which some square blocks are 
scored along the main diagonal such that each horizontal or vertical 
strip contains at most one scored block, and 

(b) the set of the following admissible transformations with each D: 

(i) arbitrary elementary transformations within strips with the fol- 
lowing restriction: each scored block is reduced by similarity trans- 
formations (i.e., we can make an elementary column transforma- 
tion in any vertical strip, but if it contains a scored block then we 
must make the inverse row transformation in the horizontal strip 
containing this scored block); 

(ii) if M is a column in vertical strip i, v is a column in vertical strip 
j, and i < j, then we can replace v hj v + au, a G F; 

(iii) if u is a row in horizontal strip i, v is a row in horizontal strip j, 
and i < j, then we can replace v hj v + au, a G F. 

Thus, all admissible additions between different strips are from left to 
right and from top to bottom. 

A canonical form with respect to transformations (i)-(iii) was obtained in 
[16] . In particular, it was shown that each D is reduced by transformations 
(i)-(iii) to a matrix with additional partition into blocks such that every 
horizontal or vertical strip contains at most one nonzero block and this block 
is nonsingular. We recall this reduction in Section HI it will be used in Section 

El 

Lemma 11. Let {A,B) be a pair of mutually annihilating matrices in which 
A is nilpotent. Then {A, B) is similar to some pair ( J^, C) in which is 
of the form f|T3l) . If we restrict ourselves to those similarity transformations 
with C that preserve , then 
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• we obtain the chessboard matrix problem for the submatrix (ITS]) whose 
scored blocks are Du, D22, • • • , Du; 

• the blocks of C outside of D remain zero under these transformations. 

Proof. We reduce C by transformations (|T9l) . Partition 5* conformally to the 
partition of J ^ in (|T3|l : 



■^11 



S 



It 



tl 



Stt 



(20) 



Since S commutes with J^, each Sij has the following form described in 
m Chapter VIII, §2]: 
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JD/f p/ p 

ij ij *J 
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R'iA R'i A R' 
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(21) 



r,- X r 



(every Sij consists of mirrij blocks of size 

Substituting (fT6|) and (!20|) into SC = CS and omitting zero entries, we 
obtain 



R 



11 
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■tl 







Rtt 
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11 



It 



Di 



tl 



Di 



Du 



R 



11 
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It 







Rt 



in which the first and the forth matrices are the submatrices of S formed by 
the blocks of Sij at the positions {mi,mj) and (1, 1), respectively. Then 



D 



11 



D' 



It 



Di 



tl 



Di, 



'R-' 



11 







Ri+^ 



Du 
Dti 



Du 
Du 



Rii 







Rtt 



where the stars denote arbitrary blocks. Thus, D is reduced by transforma- 
tions (i)-(iii) from Definition [TOl □ 
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Appendix: A proof of Lemma [TT] by elementary trans- 
formations 

In this appendix we show that Lemma [TT] can also be proved by elementary 
transformations. This primitive proof makes the reduction to chessboard 
matrix problem clearer, but the reader may omit it. 

For simplicity, we assume that all Jordan blocks of A are at most 3-by-3, 
the general case is considered analogously. Then 

J = Jl(0) © ■ ■ ■ © Ji(0) © J2(0) © ■ ■ ■ © J2(0) © J3(0) © ■ ■ ■ © J3(0), 

^ V ' ^ V ' V ' 

p times q times r times 

The pair {A, B) is similar to 



where p, g, r are natural numbers or zero. 
( J^, C), in which 



= MOp) © J2(0,) © JsiOr 



Since J+C = CJ+ = 0, 



0. 



0, 0, 
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(22) 
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Let us prove that the similarity transformations with ( J^, C) that pre- 
serve induce on 

D^2 D^3 
D := D21 X^2 -D23 

-031 -D32 X^3_ 

(in which the blocks Du, D22, D33 are scored) the chessboard matrix problem. 

(i) We can make with D transformations (i) from Definition [10] using the 
following transformations within six horizontal and six vertical strips 
of and C: 
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— Any elementary column transformation in the first vertical strip 
of and C simultaneously, and then the inverse row transfor- 
mation. 

— Any elementary column transformation in the second vertical strip 
of and C and then the inverse row transformation. The latter 
transformation spoils the identity block at the position (3,2) in 
fl22l) . we restore it by the inverse row transformation in the third 
horizontal strip and then make the initial column transformation 
in the third vertical strip. 

— Any elementary column transformation in vertical strips 4, 5, 6 
simultaneously, then the inverse row transformation in horizontal 
strips 4, 5, 6. 

Thus, Dii, D22, and 1^33 are reduced by similarity transformations. 

(ii) We can make with D transformations (ii) from Definition [TU] as follows. 
We can add a column of vertical strip 1 in D to a column of vertical strip 
2 or 3 since the corresponding transformation in and the inverse row 
transformation do not change J^. We can add a column of vertical strip 
2 in D to a column of vertical strip 3; the corresponding transformation 
in may spoil the zero block (3,4), we restore it by adding rows of 
horizontal strip 5 and the inverse column transformations do not change 
J+. 

(iii) We can make with D transformations (iii) from Definition [10] as follows. 
We can add a row of horizontal strip 1 in D to a row of horizontal strip 
2 or 3 since the corresponding transformation in does not change 
J^. We can add a row of horizontal strip 2 in D to a row of horizontal 
strip 3; the corresponding transformation in may spoil the zero 
block (6, 2), we restore it by adding columns of vertical strip 5. 

4 Solving the chessboard matrix problem 

In this section we prove the following lemma 

Lemma 12. Let D be a block matrix in which some square blocks are scored 
along the main diagonal such that each horizontal or vertical strip contains 
at most one scored block. Then there is an algorithm that 
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(a) using transformations (i)-(iii) from Definition [73 and 

(b) making additional partition of strips into substrips such that the parti- 
tion of each scored block into horizontal substrips duplicates its partition 
into vertical substrips {i.e., all diagonal subblocks of scored blocks are 
square) 

transforms D into a matrix Dq partitioned into subblocks such that 

each horizontal or vertical substrip contains at most one , . 
nonzero subblock and this subblock is nonsingular. 

Proof. We use induction on the size of If the first horizontal strip of D is 
zero then we can delete it reducing the size of D. Hence we can suppose that 
the first horizontal strip of = [Dij] is nonzero; let Di^ be the first nonzero 
block. 

Case 1: Dik is not scored. By transformations (i) from Definition [TOl we 
reduce it to the form 



r h 


" 









(24) 



By adding linear combinations of columns of D that cross (transformations 
(ii)), we make zero all entries to the right of J^. By adding linear combinations 
of rows that cross Ij. (transformations (iii)), we make zero all entries under 
Ij,. Extending the partition (12^ . we divide the first horizontal strip into two 
substrips and the fcth vertical strip into two substrips. If the new horizontal 
or vertical partition goes through the scored block, then we make the perpen- 
dicular partition (vertical or horizontal, respectively) such that this block is 
partitioned into 4 subblocks with square diagonal subblocks scored along the 
main diagonal. Denote the obtained matrix by D. For example, if the new 
horizontal partition and the new vertical partition go through scored blocks 
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F and G, then 



D = 
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Ir 
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By the canonical substrips we mean the horizontal substrip containing Ir 
and the vertical substrip containing (we call them "canonical" since they 
are substrips of the canonical form of D with respect to transformations 
(i)-(iii)). Denote by E the block matrix obtained from D by deleting the 
canonical substrips. 

We will reduce D by those transformations (i)-(iii) (defined with respect 
to the initial partition of D into blocks) that preserve Dik and the canonical 
substrips. Let us show that these transformations induce on E the chessboard 
matrix problem. 

• Using transformations (i) we can add columns of the first vertical sub- 
strip that goes through F to columns of the second vertical substrip 
that goes through F. Since F is scored, we must make the inverse row 
transformation in F. This may spoil the zero subblocks of F above F21 
and F22, we restore them by adding linear combinations of columns of 

• We can add rows of the first horizontal substrip that goes through G 
to rows of the second horizontal substrip. The inverse transformation 
of columns in G may spoil the zero subblocks of G to the left of G12 
and ^22; we restore them by adding linear combinations of rows of Ir- 

By induction on the size, Lemma [12] holds for E; that is, E is reduced to 
a block matrix Eq satisfying the condition ([2SD- Replacing E by Eq in D 
and making the additional partitions into subblocks in accordance with the 
additional partitions in Eo, we obtain a block matrix Dq satisfying (l23!l . 
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Case 2: Di^ is scored and nonnilpotent. We may reduce it by similarity 
t r ansf ormat ions . 

Convert Dik to the form i^' © in which i^' is a nonsingular Frobenius 
matrix and N is nilpotent (if Dik is nonsingular then does not appear). 
Using transformations (ii) and (iii), we make zero all entries to the right of 
K and under K and obtain the matrix 



D :-- 






... 


K 





... 





... 







* ... * 









* 






* 






* 









* 





(25) 



Denote by E the block matrix obtained from (1251) by deleting the horizontal 
and vertical substrips containing K. 

We will reduce (1251) by those transformations (i)-(iii) that preserve the 
zeros to the right of K and under K and that transform K into a nonsingular 
matrix and into a nilpotent matrix. These transformations induce on E 
the chessboard matrix problem. By induction on the size, Lemma [T2] holds 
for E] that is, E is converted to a block matrix Eq satisfying the condition 
( |23|) . Replacing E by Eq in (1251) . we obtain a block matrix Dq satisfying 
(123]). 

Case 3: Dik is scored and nilpotent. Reduce it by similarity transformations 
to the form 



®Jmt{Ort), mi> m2> ■ ■ ■ > mt, (26) 



in which Jmii^rJ is defined in f|T^ . Using transformations (ii) and (iii), make 
zero all entries to the right of 
converts D to the form 











D := 





Dik 






* 


Q 


* 



and under 7^. 


for each 1^ 


in i 





Jm\ (Ori ) 





Ti 








Jmt (Ort) 




* 




... Qt 


* 



(27) 
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(we do not draw partitions into strips except for the strips of Dik), in which 



Fi 



t. 



(rrii strips), 



[0 



Gj] [nii strips) 



for z = 1 , . 

By the canonical substrips we mean all horizontal and vertical substrips 
of D that contain J^. from Dn^. Delete in D the canonical substrips and 
obtain the block matrix 



E 






^1 





























Ft 


* 






Gt 


* 



(28) 



partitioned as D, in which we divide additionally the first horizontal strip 
and the kth vertical strip into t substrips of sizes ri, . . . , ; the line in D that 
scores along its diagonal becomes the line in E that scores the diagonal 
blocks 0^^ , . . . , Ort along their diagonals. 
Let us show that 

the transformations (i)-(iii) from Definition [10] with D 

that preserve the canonical substrips and Di^ induce the (29) 

chessboard matrix problem on E. 



The first horizontal strip of D is reduced by transformations that preserve 



D 



Ik- 

By the latter equality and (!26l) . S has the form defined in (!20|) and (I2T]) . 
Then 

{s®r)D' = b{i®s®i) 

implies 



-Rii 
Rti 





Rtt 



I^E' = e(i 



Rii 




Rtt 
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(in which E' is defined by 
so 

E' 



with Fi and replaced by F- and G'^, and 
Rii * 



I]E I 







Rtt 



where the stars denote arbitrary blocks. Thus, the substrips of the first 
horizontal and the kth vertical strips of E are reduced by transformations 
(i)-(iii) from Definition [T0| which proves (l29ll . 

By induction on the size, E converts to a block matrix Eq satisfying 
the condition ( |23l) . Replacing E by Eq in (1271) . we obtain a block matrix 
satisfying ([23]). □ 



by elementary transforma- 



Appendix: A proof of 
tions 

The key statement in the proof of Lemma [T2] is (1291) . In this appendix we 
derive the statement ( |29l) using elementary transformations (the reader may 
omit it). 

For simplicity, we use 

Dik := ^5 (Op) © J3(0,) 
in place of (l26l) . then the matrix fl27|) takes the form 

J) 7 











D = 







T 




* 


Q 


* 



1 





Op 














Fi 


2 





/p Op 

















3 







Op 
















4 







h 


Op 













5 











Op 











6 













0, 






F2 


7 














h 


0, 







8 

















0. 







* 





















* 



Let us restrict ourselves to those transformations (i)-(iii) from Definition 
[To] with D that preserve the canonical substrips and Dik, and prove that 
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they induce the chessboard matrix problem on the submatrix 



1 6 



1 










Fi 


E = 6 










F2 




* 


Gi 


G2 


* 



in which the blocks Op and Og are scored. 

(i) We can make with E transformations (i) from Definition [10] using the 
following sequence of transformations in D: 

- First, make any elementary row transformation in Fi. Since the block 
Dik is scored, we must make the inverse column transformation in ver- 
tical substrip 1 of IDi^. This spoils the subblock Ip in position (2,1) of 
Difc, we restore it by the initial row transformation in horizontal sub- 
strip 2. The inverse column transformation spoils Ip in position (3,2), 
we restore it by the initial row transformation in horizontal substrip 
3, and so on. Thus, preserving the submatrix J5(0p) in Dik, we must 
make any elementary transformation of rows in horizontal substrips 1, 
2, 3, 4, 5 simultaneously (in particular, of rows of Fi) and then the 
inverse transformation of columns in vertical substrips 1, 2, 3, 4, 5 (in 
particular, of columns of Gi), and so the subblock Op in E is scored. 

- Analogously, we can make any elementary row transformation in hori- 
zontal substrips 6, 7, 8 and then the inverse column transformation in 
vertical substrips 6, 7, 8, and so the subblock 0^ in E is scored. 

(ii) For each p x g matrix 5*, we can replace G2 by G2 + GiS as follows. 
Add vertical substrips 3, 4, and 5 of Dik-, multiplied on the right by 5*, to 
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vertical substrips 6, 7, and 8, respectively: 



• (seses) 




12345678 



-(5® 5® 5)- 



1 





Op 














Fi 


2 





Ip Op 

















3 







Op 















4 







Ip 


Op 













5 









Ip 


Op 











6 













0. 








7 













I, 









8 
























* 



















G2 


* 



This transformation replaces G2 by G2 + G1S but also replaces the zero sub- 
blocks (4,6) and (5,7) of Dik by S. The inverse row transformation restores 
the zero subblocks (4,6) and (5,7) but spoils zero subblocks of horizontal sub- 
strip 3 to the right of Dik. We restore them by adding linear combinations 
of columns of Ip. Therefore, E can be reduced by transformations (ii) from 
Definition M 

(iii) For each q x p matrix S, we can replace F2 by F2 + SFi as follows. 
Add horizontal substrips 1,2, and 3, multiplied on the left by S, to horizontal 
substrips 6, 7, and 8, respectively: 



(5®5®5) • 











i 


i-s 


9S® 


S) 












1 


2 


3 


4 


5 


6 


7 


8 




1 





Op 
















Fi 


2 





Ip 


Op 

















3 







Ip 


Op 















4 









Ip 


Op 













5 











Ip 


Op 











6 





















F2 


7 















I, 









8 

















I, 


0, 







* 






















G2 


* 
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This transformation replaces F2 by F2 + SFi but also replaces the zero sub- 
blocks (7,1) and (8,2) in Di^ by S. The inverse column transformation re- 
stores subblocks (7,1) and (8,2) but spoils zero subblocks in vertical substrip 
3 below Dik- We restore them by adding linear combinations of rows of Ip. 
Therefore, E can be reduced by transformations (iii) from Definition [TOl 

5 Proof of Theorem [7] 

Let A and B be mutually annihilating operators on a vector space V over a 
field F. Let A and B be their matrices in some basis of V. Changing the 
basis, we can reduce {A,B) by similarity transformations ([T]). By Lemma 
M^Si), {A,B) is similar to f[T^ . in which every summand (<l'j,0„-) is of cycle 
type: it is given by the ordinary loop O associated with $j. The direct sum 
(fT2|) is uniquely determined by {A, B), up to permutation of summands and 
replacement of {A', B') by a similar pair. 

Hence, it suffices to prove Theorem [7] for pairs {A, B) in which A is 
nilpotent. Then A is nilpotent too. 

Lemma 13. Let {A,B) he a pair of mutually annihilating matrices in which 
A is nilpotent. Then the algorithm from Sections and [7] reduces {A, B) 
by similarity transformations to a pair {Ao,Bq) of matrices that can be con- 
formally partitioned into blocks such that each horizontal or vertical strip 
contains at most one nonzero block and this block is nonsingular. 

Proof. By Lemmas [TT] and [T2| {A,B) is similar to some pair {Aq,Bq) : = 
( J^, C) of block matrices in which is of the form f|T3|) and the submatrix 
D of C defined in f lTTl) and f|T8l) is additionally partitioned into subblocks 
such that each horizontal or vertical substrip contains at most one nonzero 
subblock and this subblock is nonsingular. 

Since all diagonal blocks Du, D22, ■ ■ ■ , Du of D are scored, by Lemma 
[TW b) the diagonal subblocks of each Da (with respect to the new partition) 
are square; that is, the partition of Da into horizontal substrips coincides 
with its partition into vertical substrips. Each Cu in fll7p consists of 
square blocks of the same size and one of them is Da; we partition each 
block of Cu into subblocks conformally to the partition of Du and extend 
this partition to the whole C. Since all subblocks of C outside of D are 
zero, each horizontal or vertical substrip of C contains at most one nonzero 
subblock and this subblock is nonsingular. 
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Partition into subblocks conformally to the partition of C into sub- 
blocks. The partition fll4l) of each Jm^(OrJ into blocks is conformal to the 
partition f|T71) of Cu into blocks; moreover, the partition of each /^^ in Jmi(OrJ 
is conformal to the partition of Da into subblocks. Thus, all diagonal sub- 
blocks of In are square; i.e., they are the identity matrices. □ 

Let {A, B) be given by a pair (Aq, Bq) of block matrices described in 
Lemma [131 Decompose the vector space V into the direct sum 

V = Vi®---®Vt (30) 

conformally to the partition of Aq and Bq into blocks. 

Let us construct a graph F with vertices 1, 2, . . . , t, ordinary arrows — ^, 
and double arrows as follows. If block of Aq is nonzero, then 

AVj C Vi, we draw j — > i. If block (i, j) of Bq is nonzero, then BVj C V^, 
we draw j =^ i. 

Thus, the number of arrows is equal to the number of nonzero blocks in 
Ao and Bq. The number of arrows in each vertex j is at most 2. If it is 2 
then there are only 3 possibilities for the behaviour of arrows in j: 

i — > j — > k, i — > j j ^ k, 

because 

• the cases i — > j < — k and i =^ j ■'^= k are impossible since each 
horizontal strip contains at most one nonzero block, 

• the cases i < — j — > k and i j =^ k are impossible since each 
vertical strip contains at most one nonzero block, 

• the cases i — > j =^ k and i =^ j — > k are impossible by AB = 
BA = 0. 

Therefore, each connected component of the graph F is either a path graph 
([2]) or a cycle graph ([5]) (up to renumeration of vertices). 

Let Fi, . . . , Fr be all connected components of F. For each F/, denote by 
Wi the direct sum of all spaces Vi from fISUl) that correspond to the vertices 
of F;. Clearly, Wi is invariant under the operators A and B. Denote by Ai 
and Bi their restrictions on Wi. Then 

V = Wi®---®Wr, {A,B) = {Ai,Bi)®---®{Ar,Br). (31) 
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Case 1: r = 1. Then F is of the form ([2]) or ([S]), each vertex i is assigned 
by the vector space Vi and each arrow i — [i] with 

[1]:=2, [t-l]:=t, [t]:=l 

is associated with the hnear bijection jFj between the corresponding vector 
spaces, which is induced by A or B. Starting from a basis in Vi and taking the 
images or preimages with respect to JF^, . . . ^Tt~\-, we sequentially construct 
the bases in V2, . . . , V^. The linear bijections . . . , Tt-\ are given in these 
bases by the identity matrices 

i^i = ■ ■ ■ = i^t-i = /d, d := dim V^. (32) 

If r is a path graph, then the pair (^, i3) is the direct sum of d pairs of 
path type (see Definition [3]). 

Let r be a cycle graph of the form 

If ^ is periodic (see Definition O^ii)), then we make it aperiodic as fol- 
lows. The sequence (ci, . . . , q) defined by ffTTj) is periodic; i.e.. 



(Ci, . . . , Ct) — (Ci, . . . , C,-; C-r+l, . . . , C2t\ ■ ■ ■] C(g_i)T-+i, 



• 5 Cg-r 



for some t < t that divides t. Let r be the minimal number with this 
property. Replace T by the graph that is defined by the sequence (ci, . . . , c^) 
and replace each (z = 1, . . . , r) by V^, © Vi+^ © Vi+2T © . . . . The obtained 
graph is aperiodic and gives the same pair of mutually annihilating operators. 

Thus, r is aperiodic. Choose other bases in Vi, . . . ,Vt using transition 
matrices Si, . . . , St. Then Fi changes by the rule 



I Sri^FiSi if i — > \t\ , 

K = < W ^ ^ ' i = l t 

Si FiS[i\ if I ^= [t 



and so the matrix 



changes by the rule 




G, 



G'i = S, ^GiS\i}, i = 1 t. 



If Si = ■ ■ ■ = St, then the matrices (1521) do not change and Gt is reduced 
by similarity transformations. Convert it to the Frobenius canonical matrix 

$ = $1 © ■ ■ ■ © $p (33) 
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in which every $j is an x Frobenius block of the form (jlj), and obtain 

= (/,...,/,$). (34) 

Then taking 

(^i,...,^,) = (/,. ..,/,$,...,$) 
we may convert flMl) into 

= (/,.. .,/,$,/,...,/) (35) 

with $ at any position. 

Since F is aperiodic, it contains at least one double arrow; otherwise 
it is the ordinary loop O associated with a nonsingular matrix, but this is 
impossible since A is nilpotent. Let i [i] be any double arrow. By (135!) 
with $ at the position i, we can associate G'- = = $ with this arrow. By 
(l33l) . {A, B) is the direct sum of p pairs of cycle type (see Definition [5]). 

Case 2: r > 1. Each pair {Ai, Bi) in the decomposition ( !3TI) corresponds 
to the connected graph F;. Reasoning as in Case 1, we decompose {Ai,Bi) 
into a direct sum of pairs of path or cyclic type. 

Thus, we have decomposed {A, B) into a direct sum of pairs of path and 
cycle types, which proves the existence of the decomposition from Theorem 
[3 By (|35l) . for each cyclic graph that corresponds to a summand of cyclic 
type, we can transfer the Frobenius block associated with a double arrow to 
any other double arrow. 

This decomposition is uniquely determined by {A, B) up to transforma- 
tions (i) and (ii) from Theorem [7|(a) since each direct summand is inde- 
composable and distinct summands are isomorphic if and only if they are 
of cyclic type and the corresponding cyclic graphs coincide up to transfor- 
mations (ii). Hence, we can use the Krull-Schmidt theorem p?, Chapter 1, 
Theorem 3.6], which ensures that each quiver representation is isomorphic to 
a direct sum of indecomposable representations determined uniquely up to 
isomorphism of summands. Hence, each system of linear mappings uniquely 
decomposes into a direct sum of indecomposable systems, up to isomorphism 
of summands (moreover, by [201 Theorem 2] each system of bilinear forms 
and linear mappings over C and M uniquely decomposes into a direct sum of 
indecomposable systems, up to isomorphism of summands). 

This proves the statement (a) of Theorem [71 The statement (b) follows 
from (a) since two pairs of linear operators are isomorphic if and only if their 
matrix pairs are similar. 
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